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(54) Mechanism to identify instruction word boundaries in cache 



(57) A mechanism which manages variable length 
instructions in cache is comprised of three cooperating 
elements designed to optimize self modifying code and 
anticipate next instructions for branch operand manage- 
ment. A content addressable memory (CAM) stores ad- 
dresses of lines which have been accessed for instruc- 
tion fetching. In a system having modifiable instruction 
stream (i.e., store to instruction stream), when the CAM 
matches, the system must retire certain instructions, 
flush instructions and then fetch the modified instruction 
stream. Boundary identification logic examines afield in 
each cache byte to determine the nature of the byte. 
This field is initially cleared at the time the cache line is 
loaded and filled with the line is fetched. An anticipation 
buffer designed to minimize the circuitry necessary for 
fetches across cache lines is loaded with sequentially 
anticipated prefetched instructions from the cache. 
These anticipated instructions can then be concatenat- 
ed by a fetch aligner. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention generally relates to fetching 
instructions from an instruction cache (l-Cache) and, 
more particularly, to an effective mechanism for simul- 
taneously fetching multiple instructions in a pipelined 
microprocessor with minimum complexity for high 
speed out-of-order instruction execution in microproc- 
essor architectures, including those that permit store to 
the instruction stream (i.e., self-modifying code). 

Description of the Prior Art 

In certain microprocessor architectures, variable 
length instructions are permitted. The Pentium® micro- 
processor (sometimes referred to as X86 architecture) 
by Intel, for instance, supports instructions from one to 
fifteen bytes in length. In order to achieve high perform- 
ance, it is desirable to prefetch and dispatch multiple 
instructions in one cycle. To be able to fetch multiple in- 
structions at a time in such an architecture, the hardware 
required can be extensive since instructions can start 
on any byte boundary and knowledge of the length of 
each preceding instruction is needed to detect the 
boundary. 

In order to support an architecture that allows self 
modifying code, that is, the ability to store to the instruc- 
tion stream in such a way that out of sequence execution 
will execute the modified instruction stream as if the 
Store-to-the-lnstruction-stream event had occurred in 
sequential "Program Order", a microprocessor must de- 
tect the occurrence of an Instruction Fetch where a pre- 
ceding recent store has potentially modified the instruc- 
tion stream. Due to the presence of separate Instruction 
cache (I -Cache) and Data cache (D-Cache), out of se- 
quence execution and pipelining, the occurrence can be 
very difficult to handle. The offending store operation 
may occur after "later 0 instructions have been specula- 
tively dispatched down the pipeline. The performance 
hit must be minimized. 

In a high performance microprocessor, it is desira- 
ble to utilize caches; further, it is desirable to fetch wide 
bandwidth fields, i.e., lines from the cache, in order to 
achieve the desired performance. Instructions can be 
variable length and can straddle the field boundary in 
many architectures. In order to achieve performance of 
a superscaler design where instructions are executed 
out of order and more than one execution element exists 
and in order to minimize the amount of logic and com- 
plexity, it is desired to buffer the current line, the next 
sequential line and the branch target line simultaneous- 
ly- 

An example is the Branch instruction. For the 
Branch instruction, the instruction itself may straddle the 



field boundary. In one reduced instruction set computer 
(RISC) microprocessor example, a 32-byte line (field) is 
• fetched from the l-Cache at a time. A Branch instruction 
may begin with the first byte of the instruction in field 1 , 
5 the rest of the instruction in field 2 and the branch target 
instruction in field 3. The problem is minimizing the per- 
formance impact of accessing the three fields sequen- 
tially. 

Prior art (Intel's Pentium® microprocessor, for in- 
stance) implements a method where the cache could be 
fetched on a line boundary or a half line boundary. This 
means that if the instruction fetched begins in the higher 
order 16 bytes, the 32 bytes of that line are returned to 
the processor. If, however, the first byte of the instruction 
fetched is in the lower 16 bytes, those 16 bytes will be 
concatenated to the high order 1 6 bytes of the next se- 
quential line. Thus, an instruction that resides in the 
cache can always be fetched in one cycle. This is com- 
plex to implement and takes many circuits. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to 
provide an improved mechanism that supplies instruc- 
tion location information which facilitates simultaneous 
instruction decode and more than one variable length 
instruction at a time. 

It is another object of the invention to provide an 
effective mechanism of minimized complexity to permit 
high speed out-of-order instruction execution in micro- 
processor architectures that permit store-to-the-instruc- 
tion-stream operations. 

It is a further object of the invention to provide a 
mechanism that facilitates instruction decode of more 
than one instruction at a time even when a speculative 
branch is taken. 

According to the invention, there is provided a 
mechanism to identify instruction boundaries by the use 
of tag bits in the instruction cache. These tag bits signif- 
icantly speed up instruction decode and subsequent ex- 
ecution of software. This is particularly important for in- 
structions that are variable length, in particular, the in- 
vention improves the performance in software loops for 
variable length instructions. The mechanism is com- 
prised of three cooperating elements which are de- 
signed to optimize instruction boundary management, 
track cache management to support and optimize self 
modifying code, and anticipate next instructions for 
branch operand management. The three elements are 
a content addressable memory (CAM) for storing an in- 
struction address for each of a plurality of instructions, 
boundary identification logic for identifying instruction 
boundaries for each of the plurality of instructions held 
in cache, and an anticipation buffer holding a next in- 
struction or the target instruction of a speculative 
branch. 

In operation, the CAM stores most recent address- 
es of cache lines which have been accessed for instruc- 
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tion fetching. In a microprocessor system having a mod- 
ifiable instruction stream (i.e., store-to-instruction- 
stream), store operand addresses are compared with 
the address in the CAM and, if a match is found, that is 
an indication of a possible "Store-to-lnstruction-steam" s 
event. When the CAM matches, the system must retire 
certain instructions, flush instructions, and then fetch the 
modified instruction stream. Thus, upon detection of a 
possible store to the instruction stream by a CAM hit, all 
instructions prior to the store instruction are completed 10 
and all of the subsequent instructions are terminated 
and the updated line is fetched from memory to the 
cache. In a store-in cache, the boundary field bits are 
reset to "0". 

The boundary identification logic evaluates a is 
boundary field in each cache byte which provides an in- 
dication of the nature of the byte. This field is initially 
cleared at the time the cache line is loaded and written 
when instructions are fetched from the cache. 

The anticipation buffer is designed to minimize the 20 
circuitry necessary for fetches across cache lines. The 
anticipation buffer is loaded with sequentially anticipat- 
ed prefetched instructions from cache and branch target 
instructions. These anticipated instructions can then be 
concatenated by a fetch aligner. 25 

BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and ad- 
vantages will be better understood from the following 30 
detailed description of a preferred embodiment of the 
invention with reference to the drawings, in which: 

Figure 1 is a block diagram illustrating a superscaler 
instruction flow for high speed out-of-order instruc- 
tion execution; 

Figure 2 is a block diagram illustrating an instruction 
boundary mark using a U T" field according to the in- 
vention; 

Figure 3 is a hypothetical flow diagram showing a 40 
store to the instruction stream; 
Figure 4 is a block diagram showing the content ad- 
dressable memory used to detect a store to the in- 
struction stream; and 

Figure 5 is a block diagram showing a fetch aligner 45 
which includes an anticipation buffer according to 
the invention. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT OF THE INVENTION so 

Referring now to the drawings, and more particular- 
ly to Figure 1 , there is shown an improved microproces- 
sor instruction handling design according to the inven- 
tion to support simultaneous fetching and dispatch of in- ss 
structions in a single cycle. Instructions and data are 
fetched from memory 11 and stored in cache 12. The 
cache. 12 is included, as is known in the art, to improve 



system performance when accessing memory 11. The 
cache 12 may be a single unit or multiple units such as 
an instruction cache (l-Cache) unit and a data cache (D- 
Cache) unit. The cache supplies a multiplicity of bytes 
(called a line) in a single cycle. In the example imple- 
mentation, the line is 32 bytes wide. 

Also included is a branch history table (BHT) 13, 
also known in the art, the purpose of which is to supply 
speculative branch target instructions to improve per- 
formance. The branch history table allows the instruc- 
tion execution to proceed speculatively with a high de- 
gree of likelihood that the branch guess is good, reduc- 
ing the latency of waiting for the branch instruction to be 
executed. An instruction fetch unit 1 4 in conjunction with 
the program counter (PC) 15 prefetches instructions 
from the cache 12 speculatively in order to reduce la- 
tency of instruction access. The instruction fetch unit 14 
operates in conjunction with the BHT 13 such that if a 
branch is encountered, its target is supplied by a branch 
target anticipation cache (BTAC), not shown in the draw- 
ing but which may be part of the instruction fetch unit 
14. Anticipation buffers in the instruction fetch unit 14 
hold the current instruction cache line as well as the next 
cache line. Speculative streams of instructions are 
prefetched and aligned in this hardware such that a 
branch instruction that straddles two lines will be resi- 
dent in two lines of anticipation buffers while the BTAC 
line that contains the speculative target is available as 
well. The anticipation buffers work in conjunction with 
the PC 15 such that the appropriate lines are concate- 
nated and shifted appropriately. This process is well 
known in the art and, therefore, will not be discussed in 
more detail. 

The instructions in cache 12 are decoded and dis- 
patched by a dispatch unit 16 to multiple execution ele- 
ments 17 1 to 17 n in a single cycle. The instructions are 
dispatched to the multiple execution elements 1 7 r to 1 7 n 
where they are executed without being limited to pro- 
gram order. The results of the execution units temporar- 
ily stored in completion buffer 18 and, under the control 
of the writeback unit 1 9, are written to cache 1 2 for later 
storage in memory 11. 

In order to reduce latency in fetching multiple in- 
structions in a cycle where instructions can be of varia- 
ble length, the instruction boundaries are marked in the 
cache 12 such that when the line is fetched, the align- 
ment logic of the instruction fetch unit 14 knows where 
the instruction operands are without first sequentially 
decoding the instructions. The mechanism will fetch the 
instructions sequentially on the first pass through the 
line and will mark the boundary with special tag bits in 
the cache 12. Thus, on successive passes through the 
instruction stream, the boundaries are known and mul- 
tiple instructions can be decoded and dispatched simul- 
taneously. 

Figure 2 illustrates the marking mechanism where 
the T" field 21 is not visible to the programmer, each 
byte 22 in the cache 12 having an associated "T" field. 
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This field 21 not only marks the beginning of a variable 
length instruction as shown, but also contains critical in- 
formation about the instruction to reduce decode time. 

Figure 3 shows an example of a store to memory 
operation in the instruction stream as in the case of self 
modifying code. The instruction line sequence is from 
instructions A to B to C, in sequence. However, in the 
example depicted, the result of instruction C is a store 
to memory operation which modifies instruction B, and 
the sequence then proceeds from instruction B to in- 
structions D and E in that sequence. 

In order to provide the possibility that a store to 
memory operation is directed to the instruction stream 
(self modifying code), as generally indicated by the in- 
struction line sequence depicted in Figure 3, hardware 
is included, shown in Figure 4, that detects the rare con- 
dition that this has occurred. Figure 4 shows an instruc- 
tion boundary content addressable memory (CAM) 41 
which is written with the instruction address each time 
a cache line boundary is crossed due to an instruction 
fetch, such that it contains the most recent cache line 
addresses associated with the most recent instructions 
fetched. The CAM 41 receives the address of a store 
line from register 42 as a search argument and gener- 
ates a match indicator if the search finds a match in the 
CAM 41 . The match indicator is provided to the comple- 
tion buffer 18 (Figure 1) to prevent subsequent instruc- 
tions in the pipeline from completing so that they can be 
purged and refetched subsequent to the store opera- 
tion. 

The CAM 41 has entries written each time an in- 
struction is fetched from a new line in the cache 12 (Fig- 
ures 1 and 2). The CAM 41 contains the history of all 
instruction line addresses that are associated with in- 
structions that may be in the pipeline. When a store to 
memory operation is performed, the CAM 41 is interro- 
gated and, if there is a match of the store address with 
one of the instruction addresses in the CAM, a CAM hit 
is generated. The CAM hit condition indicates that the 
store may be to the instruction stream in the pipe (or in 
the l-Cache if separate). The CAM hit condition causes 
the pipe to be flushed such that all instructions following 
the store operation in program order are purged. The I- 
Cache line associated with the store address is invali- 
dated and its tag fields are set to "OA Instruction fetching 
is then re-initiated. 

The address of each instruction that is to be exe- 
cuted is compared against a table of addresses imple- 
mented in the CAM 41 such that the entire table can be 
searched in one operation cycle. There are thirty-two 
entries in this implementation, each entry contains the 
address of a cache line (32 bytes of data) that has been 
accessed to fetch an instruction (I -Fetch). Each l-Fetch 
operation, saves the address of the line(s) fetched in the 
CAM 41 . This address is saved in the same location. in 
the CAM 41 until an instruction fetch occurs that uses a 
different line. When the line fetched is different, the next 
location in the CAM 41 is written with that address. As 



an example, if thirty-two jumps occur in sequence to dif- 
ferent lines, the CAM 41 will fill up with thirty-two differ- 
ent entries. If jumps occur alternately to only two lines, 
the CAM 41 will fill up with sixteen copies of one line and 
s sixteen of the other. The CAM 41 entries are first-in, first- 
out (FIFO). In the specific example of this implementa- 
tion, thirty-two entries is sufficient since the pipe can on- 
ly have less than twenty-five operations pending at a 
time. 

10 This mechanism allows the execution to proceed 
with the performance of ignoring the store-to-the-in- 
struction-stream event. If such an event occurs, it is de- 
tected by an address match in the CAM 41 . This Match 
event will record an exception condition in the compte- 
rs tion buffer 1 8 (Figure 1 ). The completion buffer 1 8 is re- 
sponsible for maintaining the architectural state of the 
machine. It does this by retiring instructions in order, so 
that all updates to the machine state are done in pro- 
gram order. The completion buffer 1 8 has twelve entries, 

20 so that up to twelve instructions can be in various states 
of execution at any one time. The buffer is also used to 
support precise interrupts and allow recovery from spec- 
ulative instruction execution. 

When the Store-to-lnstruct ion-stream event has 

25 been recorded, an exception signal is input to the com- 
pletion buffer 18 due to a CAM match. In response to 
this exception signal, the completion buffer 18 will retire 
the instructions prior to the offending store operation (in 
program order). When the Store operation is retired, the 

30 exception condition in the completion buffer 18 will sig- 
nal the machine to "flush" the instructions that follow the 
Store in program order from the pipe (dispatch buffer 
16, rename CAM 41, completion buffer 18 and l-Cache 
12). Subsequently, the modified instruction stream will 

35 be fetched from the cache 12 or memory 11 . 

The alignment and decoder function is implement- 
ed in the structure shown in Figure 5, to which reference 
is now made. The idea is to interpret instruction bound- 
aries and flag the bytes in the cache line to indicate 

40 where instructions start. These flags are written into an 
adjunct area of the cache 12 so that they are available 
when a line (32 bytes) of instructions are fetched. 

The fetch aligner shown in Figure 5 contains an "an- 
ticipation buffer" 51, the contents of which are 

45 prefetched from the cache 12 which is addressed by the 
Instruction Fetch Address (I FA), such that the processor 
has access to not only field 1 with the current instruc- 
tions, but also the next field (field 2) which is the next 
sequential set of instructions. Instructions from the an- 

50 ticipation buffer 5 1 are concatenated to the right of those 
in the fetch buffer 52 by the fetch aligner right shifter 53 
in response to the Current Instruction Address (CIA) . 
When the anticipation buffer 51 is "emptied' 1 , a pre-fetch 
operation will load it with thirty-two more bytes of se- 

55 quentially anticipated instructions. The anticipation buff- 
er 51 minimizes the effect of Next Sequential Instruction 
boundary crossing. 

Field 3 is obtained from the Branch Target Cache 
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(BTAC) 54 which contains a history table of Branch Tar- 
get instructions. Field 3 participates in the fetch align- 
ment similarly to the anticipation buffer 51. In the case 
of the BTAC 54, the fetch aligner will sequentially load 
the target instruction (and any additional bytes of the 
thirty-two byte BTAC) into the fetch buffer 52 sequen- 
tially concatenated to the right of the current Branch in- 
struction. The anticipation buffer 51 and the BTAC 54 
are connected to a select multiplexer 55 which supplies 
a selected field to a left shifter 56. The fetch buffer 52 is 
connected to right shifter 57, and the outputs of left and 
right shifters 56 and 57 are supplied to a merge multi- 
plexer 58. 

The "merge" function of multiplexer 58 in conjunc- 
tion with the left and right shifters 56 and 57 concate- 
nates the pre-fetched branch target instruction stream 
and the preceding instructions in the fetch buffer 52. The 
fetch buffer 52 is loaded by the bypass multiplexer 59 
which receives its inputs from cache 12 and the merge 
multiplexer 58. Instructions can be shifted up to twenty- 
one bytes at a time corresponding to the maximum of 
three 7-byte simple instructions which can be fetched 
simultaneously in the preferred implementation. 

When a cache line is active, the fields for multiple 
instructions can be decoded simultaneously to improve 
performance. For architectures that support "Self Mod- 
ifying Code" where Store operations can be executed to 
the code area of Storage, whenever a cache line is writ- 
ten, the flags are erased. If a branch occurs to the middle 
of a line, only the flags for the higher order instruction 
will be set. The preceding instructions in the target line 
cannot be set until an Instruction fetch is made that uti- 
lizes that part of the line. The technique takes advantage 
of the nature of programming that utilizes re-occurring 
code such as DO WHILE loops, and the like, for the in- 
itial pass through the loop. For code that does not re- 
occur frequently enough to stay in the cache, the mech- 
anism provides no performance advantage. 

This invention also enhances the instruction bound- 
ary pointer in the cache by encoding important informa- 
tion in the pointer. Since the instruction have previously 
been decoded in order to determine the instruction 
length, the important (machine dependent) function 
could have been extracted in the previous decode and 
stored in the boundary pointer. At the same time, this 
invention reduces the amount of logic and complexity 
needed by traditional approaches. 

In certain architectures (X86 for instance), instruc- 
tions can be variable length and the operation code may 
be preceded by prefix bytes. Also, "simple instructions" 
(those that execute in one cycle) are seven bytes or less 
in length, A preferred implementation of the invention, 
as shown in Figure 2, under these conditions include a 
Boundary Field (T) in the cache. For each byte in the 
cache line, there is a BF pair of bits. They are encoded 
as follows: 

00 = NOT A BOUNDARY 



01 = INSTRUCTION PREFIX BYTE 

10 = COMPLEX INSTRUCTION BOUNDARY (NO 
PREFIX) 

11 = SIMPLE INSTRUCTION BOUNDARY 

5 

When the cache line is first loaded in the cache (or 
when a store occurs to the cache line), the thirty-two 
2-bit BFs are cleared. When an instruction is fetched 
from the line, the appropriate BF fields are written into 
io the cache for that instruction. Only the instructions 
fetched will have BF information written back in the 
cache. Thus, for an instruction stream that first executes 
from a line in a cache, only one instruction is fetched at 
a time. However, the next time the instruction stream 
1 $ accesses the line, multiple instruction can be fetched in 
a cycle as long as their BF fields have been stored by 
previous execution. Complex instructions are not 
fetched in parallel with other instruction. They take two 
or more cycle to execute. 
20 The invention is not limited to the four encodings 
described, other enhancements would be a code (bit) 
dedicated to the instruction boundary and subsequent 
codes (bits) describing command type, operand type, 
command location (if prefixed), branch history, excep- 
ts tion history, and the like. 

Claims 

30 1 . a cache control unit comprising: 

a content addressable memory for storing most 
recent addresses of cache lines which have 
been accessed for instruction fetching for exe- 
35 cution, said instructions being of variable 

length; 

boundary identification logic responsive to said 
content addressable memory for identifying in- 
struction boundaries for each of said plurality 
40 of instructions held in cache; and 

an anticipation buffer for holding a next instruc- 
tion, said next instruction being located and 
identified by said content addressable memory 
and said boundary identification logic. 

45 

2. The cache control unit recited in claim 1 further 
comprising: 

first logic means responsive to said content ad- 
50 dressable memory for detecting an occurrence 

of a store to memory request to one of the said 
instruction addresses; and 
second logic means responsive to the first logic 
for delaying the store to memory request until 
55 previous instructions are executed and then 

refetching instructions that follow the store in- 
struction in program order. 
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3. The cache control unit recited in claim 2 wherein 
each line in cache includes a byte with an associat- 
ed boundary field which provides an indication of 
the nature of the byte, the boundary field marking 
the beginning of a variable length instruction and 
information about the instruction to reduce decode 
time, said boundary identification logic decoding 
said boundary field at a time when an instruction 
stored in an addressed cache line is fetched. 

4. The cache control unit recited in claim 3 wherein the 
boundary field is a 2-bit field encoded as follows: 

00 = NOT A BOUNDARY 

01 = INSTRUCTION PREFIX BYTE 

10 = COMPLEX INSTRUCTION BOUNDARY 
(NO PREFIX) 

11 = SIMPLE INSTRUCTION BOUNDARY. 

5. A superscaler instruction pipeline for a digital com- 
puter which supports self modifying code whereby 
a store to the instruction stream may occur in such 
a way that out of sequence execution will execute 
the modified instruction steam as if the store to the 
instruction stream operation had occurred in se- 
quential program order and wherein instructions 
can be of variable length comprising: 

a memory storing said variable length instruc- 
tions; 

a cache connected to said memory and respon- 
sive to an instruction fetch address for storing 
a subset of said instructions, boundaries of 
each of said instructions being marked in said 
cache by boundary fields; 
an instruction fetch unit connected to said 
cache for fetching instructions to be executed, 
said instruction fetch unit including an anticipa- 
tion buffer loaded with sequentially anticipated 
prefetched instructions from said cache and a 
branch target instruction;, 
a content addressable memory for storing an 
instruction address for each of a plurality of in- 
structions; 

boundary identification logic responsive to said 
content addressable memory for identifying in- 
struction boundaries for each of said plurality 
of instructions held in cache, a next instruction 
in said anticipation buffer being located and 
identified by said content addressable memory 
and said boundary identification logic; 
a dispatch unit connected to said instruction 
fetch unit for decoding and dispatching a plu- 
rality of instructions in a single cycle; 
a plurality of execution units connected to re- 
ceive instructions from said dispatch unit and 
simultaneously executing respective ones of 
the instructions; 



a completion buffer connected to said plurality 
of execution units fortemporarily storing results 
of executing instructions; 
writeback unit connected to said completion 

5 buffer for writing back results to said cache; 

first logic means responsive to said content ad- 
dressable memory for detecting an occurrence 
of a store to memory request to one of the said 
instruction addresses; and 

10 second logic means responsive to the first logic 

for controlling said writeback unit to delay the 
store to memory request until previous instruc- 
tions are executed and then refetching instruc- 
tions that follow the store instruction in program 

15 order. 

6. The superscaler instruction pipeline recited in claim 

5 wherein said instruction fetch unit comprises: 

a fetch buffer for holding instructions for decod- 
ing and dispatch by said dispatch unit; 
a branch target anticipation cache containing a 
history table of branch target instructions; and 
. alignment logic connected to said anticipation 
buffer and branch target anticipation cache and 
responsive to said marked boundaries of in- 
structions read from said cache for aligning said 
instructions without first sequentially decoding 
said instructions, said alignment logic loading 
said fetch buffer with aligned instructions. 

7. The superscaler instruction pipeline recited in claim 

6 wherein each line in cache includes a byte with 
an associated boundary field which provides an in- 
dication of the nature of the byte, the boundary field 
marking the beginning of a variable length instruc- 
tion and information about the instruction to reduce 
decode time, said boundary identification logic de- 
coding said boundary field at a time when an in- 
struction stored in an addressed cache line is 
fetched. 

8. The superscaler instruction pipeline recited in claim 

7 wherein the boundary field is a 2-bit field encoded 
as follows: 

00 = NOT A BOUNDARY 

01 = INSTRUCTION PREFIX BYTE 

10 = COMPLEX INSTRUCTION BOUNDARY 
so (NO PREFIX) 

11 = SIMPLE INSTRUCTION BOUNDARY. 

9. A method of fetching multiple instructions in a pipe- 
lined microprocessor for out-of-order instruction ex- 

55 ecution in microprocessor architectures that permit 
store to the instruction steam, said method compris- 
ing the steps of: 
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storing most recent addresses of cache lines 
which have been accessed for instruction fetch- 
ing for execution in a content addressable 
memory, said instructions being of variable 
length; 5 
logically identifying instruction boundaries for 
each of said plurality of instructions held in 
cache; 

holding a next instruction in an anticipation buff- 
er, said next instruction being located and iden- to 
tified by said content addressable memory and 
said identifying step; 

detecting an occurrence of a store to memory 
request to one of said instruction addresses in 
the content addressable memory; 15 
delaying the store to memory request until pre- 
vious instructions are executed; and 
then refetching instructions that follow the store 
to memory request in program order. 
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(54) Mechanism to identify instruction word boundaries in cache 



(57) A mechanism which manages variable length 
instructions in cache is comprised of three cooperating 
elements designed to optimize self modifying code and 
anticipate next instructions for branch operand manage- 
ment. A content addressable memory (CAM) stores ad- 
dresses of lines which have been accessed for instruc- 
tion fetching. In a system having modifiable instruction 
stream (i.e., store to instruction stream), when the CAM 
matches, the system must retire certain instructions, 
flush instructions and then fetch the modified instruction 
stream. Boundary identification logic examines a field in 
each cache byte to determine the nature of the byte. 
This field is initially cleared at the time the cache line is 
loaded and filled with the line is fetched. An anticipation 
buffer designed to minimize the circuitry necessary for 
fetches across cache lines is loaded with sequentially 
anticipated prefetched instructions from the cache. 
These anticipated instructions can then be concatenat- 
ed by a fetch aligner. 
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